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early years, has been well documented. Many early childhood programs have been 

designed to promote positive parenting and more enriched home environments 
in order to enhance children’s development. We describe findings from a multisite, ran- 
domized evaluation of the Parents as Teachers (PAT) program with 665 families, which 
was designed specifically to investigate the program’s effectiveness with low-income 
families. The observed effects of the PAT program on parenting and child development 
outcomes were generally small, with few statistically significant effects. More consis- 
tent positive effects were noted for very low-income parents and their children relative 
to more moderate income parents. The discussion focuses on the policy implications of 
the findings for the design and implementation of early childhood parenting programs 
for low-income families and future research. 


P | The association between poverty and compromised development, particularly in the 


Children in the United States have the highest rates of 
poverty in the Western industrialized world. Overall, more 
children in the United States live in poverty today (20.8%) 
than two decades ago (15%; Lewit, Terman, & Behr- 
man, 1997). The rate of poverty among young children— 
defined as the percentage of children under the age of 6 
who live in families with a combined income below the 
federal poverty line—is higher than for any other age 
group. Currently, nearly one in five young children live 
in poverty in the United States; almost half of them live 
in extreme poverty (i.e., in a household with an income 
below 50% of the poverty line; National Center for 
Children in Poverty, 2001). 

Child development experts agree that poverty exacts 
a heavy toll on children. Children from poor families are 
at greater risk for developmental problems than are chil- 
dren from non-poor families (Aber, Jones, & Cohen, 
2000; Brooks-Gunn & Duncan, 1997), and they face sig- 
nificantly reduced chances for later life success, both eco- 
nomically and socially (Zill, Moore, Smith, Stief, & 
Coiro, 1995). Furthermore, poverty incurred during the 
first 5 years of life is more detrimental to later achieve- 
ment than poverty incurred later in childhood. In sum- 
marizing current research on the association between 


economic hardship and compromised development, an 
expert panel commissioned by the National Academy of 
Sciences concluded, “Economic conditions in early child- 
hood may be far more important for shaping children’s 
ability, behavior and achievement than conditions later 
in childhood” (Shonkoff & Phillips, 2000, p. 277). 

This conclusion was based on abundant research 
showing that family income is strongly related to a 
young child’s physical health, cognitive ability, and school 
achievement (Aber, Jones, & Cohen, 2000; Brooks-Gunn 
& Duncan, 1997). Analyses of national longitudinal data 
show that children who are poor are 1.3 times more likely 
than children who are not poor to experience learning 
disabilities and developmental delays (Brooks-Gunn & 
Duncan, 1997). Additional research has found that chil- 
dren from poor families are more likely to score lower on 
standardized tests, be retained in grade, and drop out of 
school (Lewit et al., 1997; Zill et al., 1995). Emotional 
and behavioral development is also compromised by 
poverty, although to a somewhat lesser degree than cog- 
nitive development. Data from the Infant Health and 
Development Program (IHDP) show that young children 
living in chronic poverty had more internalizing and ex- 
ternalizing behavior problems than children not living in 
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poverty (Brooks-Gunn & Duncan, 1997). Children in 
poverty have been found to have lower levels of sociabil- 
ity and initiative (Hanson, McLanahan, & Thompson, 
1997), more problematic peer relations (Loeber & Dish- 
ion, 1983; Shaw et al., 1998), and more frequent dis- 
ruptive classroom behaviors (Patterson, Kupersmidt, & 
Vaden, 1990; Zill et al., 1995). 

To a large degree, the effect of income on child de- 
velopment occurs through a young child’s home environ- 
ment, including opportunities for learning through 
positive mother-child interactions and the provision of 
cognitive and emotional stimulation (Brooks-Gunn, 
Duncan, Klebanov, & Sealand, 1993; Duncan, Brooks- 
Gunn, & Klebanoy, 1994; Garrett, Ng’andu, & Ferron, 
1994). For instance, a recent study investigating the ef- 
fect of the home learning environments of high-income 
versus low-income preschool children found that the in- 
come difference accounted for as much as one half of the 
gap in their developmental test scores (Smith, Brooks- 
Gunn, & Klebanov, 1997). 

Given the high rate of young children living in pov- 
erty, it has become increasingly important to identify 
strategies that promote their well-being (Brooks-Gunn, 
1995; Brooks-Gunn & Duncan, 1997). Recent research 
has stressed that increases in income alone, absent the 
improvements in home environment, will not be sufficient 
to benefit the development of young children (Shonkoff 
& Phillips, 2000). For example, a study of children whose 
mothers received welfare payments indicated that moth- 
ers needed more than remedial education or job train- 
ing to affect their children’s development; they needed 
training in effective parenting practices. The researchers 
concluded that despite high expectations about their chil- 
dren’s performance in school, “many low-income moth- 
ers do not seem to know precisely what to do at home 
to get their children ready for school” (Zill et al., 1995, 
p. 56). Maternal parenting skills affect both home envi- 
ronment and mother-child interactions and have been 
identified as an important pathway through which pov- 
erty influences child outcomes. Increasing a young child’s 
opportunities for learning by promoting an enriched 
home environment therefore offers a promising focus for 
intervention (Brooks-Gunn & Duncan, 1997; Gomby, 
Culross, & Behrman, 1999). 

Parenting programs, often delivered through home 
visits, seek to help parents develop the knowledge and 
responsive parenting behaviors necessary to provide an 
enriched environment that supports children’s learning 
(Halpern, 2000; Kendrick et al., 2000). Growing public 
policy supports programs for families whose children may 
be particularly at risk of poor outcomes, such as families 
living with significant poverty (Duncan et al., 1994; Ken- 
drick et al., 2000; Werner, 2000). However, there is a 
great need for research about which program models are 
most effective, particularly with low-income families. Rec- 
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ognizing this need, the National Academy of Sciences ex- 
pert panel called for “rigorous evaluations that examine 
causal links between parenting interventions and specific 
parent (or parenting) outcomes and that assess mediated 
pathways from treatment effects on the parent to devel- 
opmental impacts on the child” (Shonkoff & Phillips, 
2000, pp. 407-408). 

In this article, we present data that address this 
need—data from a multisite, randomized evaluation of 
the Parents as Teachers (PAT) program that was designed 
specifically to investigate the effectiveness of this program 
with low-income families. The PAT program encour- 
ages positive child development through parenting edu- 
cation that is provided in regular home visits and group 
meetings by trained parent educators. PAT serves families 
with children through age 5, has been in operation more 
than 20 years, and currently has more than 2,600 local 
programs in the United States and six other countries 
serving more than 500,000 children annually. Four re- 
search questions regarding the effectiveness of PAT are 


addressed: 


e¢ What effects does PAT have on parents’ 
knowledge, attitudes, behaviors, and inter- 
actions with their children? 

e Are any of the effects observed for parents 
similar or different for low-income and 
more moderate income families? 

e¢ What effects does PAT have on children’s 
development? 

e Are any of the effects observed for children 
similar or different for low-income and 
more moderate income families? 


METHOD 
PAT Program Overview 


PAT is a universal-access, family-focused parent educa- 
tion program that emphasizes parenting behavior as the 
vehicle through which positive effects on children are to 
be achieved (Parents as Teachers National Center, 2001). 
PAT was designed for voluntary participation by all types 
of families and is based on the tenet that all parents de- 
serve to be supported in their role as their children’s first 
teachers. The program’s major goals are the following: 


1. Empower parents to give their children the 
best possible start in life through increased 
knowledge of child development and ap- 
propriate ways of fostering growth and 
learning; 

2. give children a solid foundation for school 
success; 

3. prevent and reduce child abuse; 
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4. increase parents’ feelings of competence 
and confidence; and 

5. develop true home-school-community 
partnerships on behalf of children. 
(Winter, 1999, p. 179) 


The PAT program involves 


e regularly scheduled home visits (typically 
monthly) by certified parent educators who 
provide information about children’s de- 
velopment, model and involve parents in 
developmentally appropriate activities, and 
respond to parents’ questions and con- 
cerns; 

® parent group meetings to discuss child 
development and build informal support 
networks with other parents; 

¢ periodic developmental screenings; and 

e referrals to community services, as needed. 


Parent educators schedule home visits at convenient 
times for the parent, discuss the child’s development, 
demonstrate and model activities with a variety of learn- 
ing materials, and address questions raised by parents. 

The PAT program model is based on the work of 
Burton White (1985), who believed that all families would 
be aided by receiving expert knowledge on parenting. 
PAT uses individual, home-based instruction and group 
interactions to inform parents of young children about 
good parenting practices and principles of child develop- 
ment. The standard curriculum used in the home visits 
begins prenatally and emphasizes different developmen- 
tal stages through the first 3 years of life. Additional cur- 
ricular materials meet the particular needs of parents of 
3- to 5-year-olds, parents who are teenagers, and parents 
whose children attend childcare centers. Improved know]- 
edge in these areas is expected to help parents feel com- 
petent in their role and to provide the environment and 
the personal interactions with their children that will sup- 
port positive child development. A healthy, well-developed 
child who is ready for school is the ultimate intended re- 
sult. (Detailed information about PAT can be found at 
www.patnc.org; see Note 1.) 


PAT Multisite Evaluation Overview 


Results presented here are part of a comprehensive mul- 
tisite evaluation that employed a randomized experimen- 
tal design to assess the effect of key parenting and child 
outcomes related to PAT program goals. This evaluation 
also sought to examine how family and program factors 
contribute to variations in child and parent outcomes, 
with a major focus on family income (more details are 
available in Wagner, Spiker, Gerlach-Downie, & Hernan- 
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dez, 2000; Wagner, Spiker, Hernandez, Song, & Gerlach- 
Downie, 2001; available at www.sri.com/policy/cehs/ 
publications/pdf) 


Sample 


The staff of the study coordinating center at SRI Inter- 
national worked with the staff at the PAT National Cen- 
ter to identify programs from which to draw the study 
sample. Initial selection criteria required that the pro- 
gram (a) be in operation for at least 2 years, (b) provide 
services to a minimum of 100 new families annually, 
(c) serve a high proportion of low-income families, (d) of- 
fer home visits at least monthly, and (e) participate in the 
evaluation. Four sites were selected to participate, but 
one site subsequently withdrew (see Note 2). The three 
participating sites were large programs in geographically 
dispersed urban areas. Meeting the evaluation require- 
ment of being able to serve a large number of new fami- 
lies makes these programs unusual in comparison to the 
majority of PAT programs. However, the sites were se- 
lected in collaboration with the PAT national center, which 
requires that staff visit PAT programs to observe their 
implementation of the PAT program model. All the sites 
selected had been certified by the PAT national center as 
implementing the PAT model with high fidelity and qual- 
ity (i.e, the types, frequency, and reliability of the activi- 
ties occurring in the home visits were implemented as the 
program designers intended). The parent educators com- 
pleted PAT training and were certified by PAT trainers. 
The parent educators in the evaluation were an ethni- 
cally diverse group; most were female, ranging in age 
from 22 to 60 years, with between 1 and 12 years of home 
visiting experience; and most had an associate, a bache- 
lor’s, or master’s degree, with training in child develop- 
ment and/or early childhood education. 

Families were recruited when children were less 
than 8 months of age (15.5% enrolled prenatally, 84.5% 
between 1-8 months of age, most between 3-6 months 
of age) and were asked to participate until the children’s 
third birthdays. Families agreed to random assignment to 
the PAT or a comparison group and understood that the 
PAT group would have monthly home visits by a trained 
and certified parent educator, beginning shortly after en- 
rollment into the study and to continue until the child was 
3 years old. Families were recruited through multiple 
sources: community information packets given to new 
parents, public health nurses who visited new mothers, 
personnel at schools that housed PAT programs, parent 
educators, and community social service agencies (e.g., 
Women, Infant, and Children [WIC] programs). Enrolled 
families were randomly assigned by the study coordinat- 
ing center to a PAT participant or control group at each 
of three sites (balancing sociodemographic factors), with 
a 60% chance of assignment to the control group and a 
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40% chance of assignment to the PAT participant group 
(group assignment probabilities were selected to increase 
statistical power while also maximizing the number of 
new families that PAT programs could accommodate). 
The program was provided free of charge, and families 
in both groups received a $20 gift certificate as an incen- 
tive to complete the annual data collection visit. (The 
evaluation was truncated at children’s second birthdays 
because too few families continued to participate beyond 
that point in two of the three communities to warrant 
continuing through third birthdays; thus, the findings 
here may underrepresent the full effects of PAT that 
might have been achieved if families had been followed 
through the natural conclusion of the program at third 
birthdays.) 

A total of 665 children and families were recruited 
and randomly assigned to the PAT participant group (N = 
275, 41%) or the control group (N = 390, 59%). Table 1 
shows the maternal and household characteristics of the 
families in the evaluation at enrollment and at the Year 2 
assessment period. Almost 60% of households reported 
incomes of less than $15,000 per year; 80% reported in- 
comes of less than $25,000. Almost one in five families 
(18%) reported receiving Temporary Assistance to Needy 
Families (TANF) benefits, and 63% participated in Medi- 
caid. 

Participant and control group parents were assessed 
at children’s first and second birthdays; children were as- 
sessed at second birthdays only. The first assessment in- 
cluded 147 (53%) participant group members, whose 
children were an average age of 12.8 months and 197 con- 
trol group members (50.5%), whose children were an 
average of 12.5 months old. The second assessment in- 
cluded 107 participant group members (39%) and 159 
(41%) control group members, whose children were an 
average of 24.5 and 24.1 months old, respectively. Com- 
parisons on maternal, child, and household character- 
istics revealed no significant or systematic differences 
between the participant and control groups at enrollment 
or at children’s first or second assessments (see Note 3). 
(Although the attrition was high, it does not affect the 
group comparisons we present in this report, but issues 
about attrition will be addressed in the Discussion sec- 
tion.) For additional information about attrition and en- 
gagement, refer to Wagner, Spiker, Gerlach-Downie, and 
Hernandez (2000), and Wagner, Spiker, Linn, Gerlach- 
Downie, and Hernandez (2002). 


Data Sources and Measures 


The data reported in this article come from the following 
sources: 


Enrollment Form. PAT recruitment staff at the study 
sites recorded demographic and background information 
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TABLE 1. Parent and Household Characteristics at 
Enrollment and at Year 2 Assessment 


Characteristics At enrollment At Year 2 
Mother’s age 
Average age 24.1 (0.4) 24.3 (0.4) 
Percentage younger than 20 28.2 (2.7) 25.2: (2:7) 
Mother’s ethnicity (%) 
European American/White 29.4 (2.8) 29.6 (2.8) 
African American 58.2 (3.0) 60.3 (3.0) 
Hispanic/Asian/Other 12.4 (1.9) 10.1 (1.8) 
Mother’s education 
Average highest grade level 12.0 (0.1) 12.1 (0.2) 
Percentage with: 
Less than high school 36.9 (2.9) 31.2 (2.8) 
Some postsecondary 
education 30.4 (3.1) 49.6 (3.1) 
Percentage currently enrolled 
in school 17.6 (2.4) 11.9 (2.0) 
Mother’s employment (%) 
Working full-time 20.8 (2.8) 27.2 (2.9) 
Working part-time 14.4 (2.4) 16.7 (2.4) 
Not working or seeking work 44.7 (3.3) 56.1 (3.2) 
Marital status (%) 
Single 54.1 (1.9) 59.2 (3.0) 
Married 30.4 (2.8) 28.1 (2.8) 
Living with partner 11.7 (1.2) 5.6 (1.4) 
Divorced, widowed, separated 3.8 (0.7) 1.5 (0.5) 


Household composition (%) 
Father living in the household 54.8 (2.9) 52.4 (3.0) 
Household has two married 


parents 29.1 (2.8) 28.1 (2.8) 
Child has siblings 40.2 (3.0) 40.4 (3.0) 
Household living arrangement (%) 
In other’s home 37.6 (2.8) 32.7 (2.9) 
Rented 43.9 (3.0) 46.5 (3.0) 
Owned their own home 18.4 (2.6) 20.5 (2.5) 
Household socioeconomic (%) 
Annual income 
Less than $15,000 59.8 (3.1) 56.9 (3.0) 
$15,000 to $24,999 20.7 (2.7) 20.6 (4.5) 
$25,000 to $39,999 7.1 (1.4) 9.7 (1.8) 
$40,000 or more 12.4 (2.1) 12.7 (2.0) 
Benefit program participation (%) 
AFDC/TANF 18.3 (2.2) 18.1 (2.4) 
Medicaid 63.2 (3.0) 60.0 (3.0) 
Sample size 663 663 


Note. Numbers in parentheses are standard errors. AFDC/TANF = Aid to 
Families with Dependent Children/Temporary Assisstance to Needy 
Families. 


about each family at the time of enrollment or shortly 
thereafter. 


Family Interview. At or around the birthdays of en- 
rolled children, families were visited in their home by a 
trained assessor, who conducted an in-depth interview. 
Assessors were hired, trained, and supervised by SRI staff 
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and were unaware of families’ group assignments. The 
interview included questions about the family’s home en- 
vironment and demographics and incorporated the in- 
struments described below. 


Parenting Knowledge and Attitudes Measures. Par- 
ent knowledge of child development and parenting atti- 
tudes were assessed with items included on the family 
interviews drawn from several parenting measures. Items 
were tailored to the age of the child, as well as to the spe- 
cific PAT curriculum covered in the first and second years 
of the program, and included some items contained in 
the Knowledge of Infant Development Inventory (KIDI; 
MacPhee, 1989). Items were summed to define subscales 
about general child development; language/cognitive de- 
velopment; emotional development; and child care and 
safety. The Parenting Sense of Competence scale (PSOC; 
Gibaud-Wallston & Wandersman, 1978) is a 17-item ques- 
tionnaire that measures parenting attitudes using posi- 
tive and negative statements about parenting that parents 
indicated were “very true for you, somewhat true for 
you, not very true for you, or not at all true for you.” 
Items were summed to yield a total score and two sub- 
scale scores for parenting satisfaction and parenting effi- 
cacy. The 6-item Child Maltreatment Precursor Scale 
(CMPS) from the Adult-Adolescent Parenting Inventory 
(Bavolek, 1984) was included as a measure of views about 
corporal punishment. Finally, we considered parents’ re- 
sponses on a 4-point scale (ranging from not at all happy 
to very happy) to the following question: In general, how 
happy have you been whenever you have taken care of 
[child’s name] in the last year? 


Home Observation and Measurement of the Envir- 
onment (HOME). The version of the HOME Inventory 
designed for families of children ages birth through 3 
years was used to assess the home environment and par- 
enting behaviors at children’s first and second birthdays 
(Caldwell & Bradley, 1984). The 45 items of the HOME 
were completed by the SRI field evaluator in the home of 
enrolled families. The full HOME score and subscale 
scores were obtained by assigning a value of 1 for every 
item answered positively during the assessment and sum- 
ming items. 


Parenting Behaviors Related to Promotion of Early 
Literacy. One area of particular interest in the PAT 
curriculum involves language-, literacy-, and numeracy- 
promoting behaviors. To assess impacts on these kinds of 
behaviors, parents were asked questions about direct 
verbal interactions with children in the course of routine 
activities (i.e., talking to children, reading aloud from 
things like cereal boxes, and counting or using numbers), 
intentionally engaging children in word play (i.e., telling 
stories, saying nursery rhymes, singing songs), and read- 
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ing to children (e.g., frequency of reading, asking ques- 
tions of the child about what is being read). Each ques- 
tion was answered on a 4-point scale, with 4 being the 
most positive response. An overall scale was formed by 
summing the values on six items. 


Nursing Child Assessment Satellite Training (NCAST). 
The teaching scale from the NCAST (1994; see http:// 
www.son.washington.edu/centers/ncast) was used at 
children’s second birthdays to assess mother-child inter- 
actions. (No measurement was taken at first birthdays 
because we did not believe sufficient change in parent— 
child interactions would have occurred by that time to 
warrant this fairly extensive and expensive measure- 
ment.) This measurement involves having the trained ob- 
server ask a mother to introduce a new toy to her child 
and record the interactions of the mother and child in the 
process of exploring the new toy. Ratings are made of 
such behaviors as cue-giving and responsiveness to cues 
of both the parent and child. 


Developmental Profile II (DPI). The DPI (Alpern, 
Boll, & Shearer, 1984) measures physical, self-help, so- 
cial, academic/cognitive, and communication aspects of 
a child’s development, as reported by his or her parent 
and observed by the field evaluator during the in-home 
assessment at age 2. The DPII contains several items that 
describe skills children can perform, in 6-month age 
ranges. Skills were assessed at increasingly higher age 
levels until the child could not perform any of the skills 
included at two consecutive age levels. 


Adaptive Social Behavior Inventory (ASBI). The 
ASBI (Scott & Hogan, 1987) is a parent-report measure 
of young children’s prosocial behavior, which was incor- 
porated in the family interviews. This instrument yielded 
a total score. 


Data Analysis 


For each parenting and child outcome measure, the par- 
ticipant and control groups were compared for families 
with very low-incomes (less than $15,000) and those of 
more moderate incomes ($15,000 or higher). (In the full 
study analyses, effects also were calculated for the full 
sample and for the sample at each participating site; see 
Wagner, Spiker, Hernandez, et al., 2001). Effect sizes, 
which express the difference between groups as a pro- 
portion of the pooled standard deviation of the two 
groups, indicate the positive or negative effects of the 
program on the participant group relative to the control 
group. Effect sizes of .10 to .30 generally are considered 
small, those from .31 to .50 are considered moderate, and 
those larger than .50 are considered large effects (Cohen, 
1988; see Note 4). In addition, t tests were done to assess 
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the statistical significance of the participant/control group 
differences at each assessment. 


RESULTS 


The results are organized according to outcomes for mea- 
sures of parenting knowledge, attitudes toward parent- 
ing, parenting behaviors, and then for measures of child 
development and behavior. 


Parenting Outcomes 


Parent Knowledge. Scores for parenting knowledge 
on most measures were notably lower for very low-income 
families, suggesting they were generally less well-informed 
parents (see Table 2). However, stronger positive effects 
were noted among the very low-income families on four 
of the six knowledge measures, with the strongest effects 
being on the overall score and on knowledge of language 
and emotional development (ES = .33, .31, and .35); none 
of the group comparisons reached statistical significance. 
In contrast, no positive effects on the parent knowledge 
scores were noted for more moderate-income families. 
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Attitude Toward Parenting. Table 3 shows only mar- 
ginally lower scores for low-income families than for 
those with more moderate incomes, unlike the differ- 
ences noted in parent knowledge scores. Also, unlike 
findings related to parent knowledge, stronger positive 
impacts did not accrue to the very low-income group. In 
fact, small-to-moderate negative effects were noted on all 
PSOC scale scores for both groups. However, there were 
small positive effects on the CMPS score in both years 
for very low-income families, compared with negative ef- 
fects for the more moderate-income group. In contrast, 
there was a large, statistically significant positive effect 
on parents’ self-reports of happiness when caring for 
their children among families with more moderate in- 
comes (ES = .58, p < .001). 


Parenting Behaviors. Scores were lower on all 
HOME measures for very low-income families than for 
those with more moderate incomes (see Table 4). 
Findings generally were inconsistent regarding whether 
the two income groups benefited differentially from par- 
ticipation in the PAT program. For example, at the sec- 
ond assessment, the largest measured effect was a 
statistically significant, moderate effect on acceptance of 


TABLE 2. Outcomes for Parent Knowledge Items, by Income Level 


Very low income 


More moderate income 


% Answered correctly 


% Answered correctly 


Participant Control Participant Control 
KIDI item group group ES group group ES 

All items 

At 1-year assessment 74.8 (1.5) 74.7 (1.4) .02 82.6 (1.7) 84.9 (1.0) -.19 

At 2-year assessment 72.3 (2.3) 68.0 (2.0) 33 80.2 (1.5) 81.2 (1.2) -.09 
General child development 

At 1-year assessment 82.3 (2.5) 76.5 (2.4) 26 84.1 (2.3) 82.8 (1.6) 08 

At 2-year assessment 67.3 (3.5) 66.6 (2.6) 04 771 (2.2) 76.0 (1.6) .07 
Language/cognitive development 

At 1-year assessment 65.6 (2.2) 70.3 (2.0) -.29 76.6 (2.1) 79.A (1.2 -.19 

At 2-year assessment 76.3 (3.6) 70.2 (2.8) 31 81.0 (2.4) 85.3 (1.5) -.27 
Emotional development 

At 1-year assessment 70.4 (2.7) 71.2 (2.6) -.04 79.9 (2.8) 82.9 (1.9 -.14 

At 2-year assessment 73.7 (4.0) 66.3 (3.0) 35 81.8 (2.3) 80.6 (2.1) .07 
Discipline 

At 1-year assessment 82.0 (2.6) 79.4 (2.6) 13 85.7 (2.5) 89.9 (1.7 -.22 

At 2-year assessment 69.7 (4.5) 68.1 (3.6) .06 78.6 (3.0) 80.2 (2.5) -.07 
Child care and safety 

At 1-year assessment 78.2 (2.5) 77.7 (2.4) .03 89.7 (2.1) 92.2 (1.5 —.16 

At 2-year assessment 66.7 (4.9) 61.7 (3.4) 20 80.0 (3.0) 82.5 (2.4) -.12 
Sample size (1-year/2-year assessment) 57/31 61/47 64/55 100/84 


Note. Bold type indicates moderate and large effects. Numbers in parentheses are standard errors. KIDI = Knowledge of Infant Development Inventory 


(MacPhee, 1989). 
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children’s behavior (ES = .49, p < .01), measured for the 
more moderate-income group. This group also had a 
stronger effect for the overall HOME score (ES = .29) 
and the opportunities for daily stimulation subscale 
(ES = .21). In contrast, the very low-income group had 
moderate effects at the second assessment on the organi- 
zation of the environment (ES = .31) and appropriate play 
materials subscales (.33), on which the more moderate- 
income group registered only small effects. 

Unlike some of the other parent outcomes examined, 
very low-income families did not have consistently lower 
scores on language-, literacy-, and numeracy-promoting 
behaviors than more moderate-income families (see Ta- 
ble 5). The very low-income group, however, did have 
more positive effects than the wealthier group at the sec- 
ond assessment, including small benefits on the overall 
language/literacy/numeracy promotion scale score (ES = 
.17) and moderate benefits on reading aloud and telling 
stories to children (ES = .31 and .49, p < .05), the latter 
effect reaching statistical significance. Effects were more 
likely to be negative than positive for the more moderate- 
income group, although all effects were small. 

NCAST measures were somewhat lower for the 
very low-income group than for less-poor families (see 
Table 6). Impacts measured by the NCAST generally 
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were positive but inconsequential for the lowest-income 
group and were small and mixed in direction for the 
more moderate-income group. 


Child Outcomes 


Scores for the five areas of child development that were 
assessed at children’s second birthdays with the DPII 
(cognitive, social, communication, physical, and self- 
help) are expressed as the average month’s difference be- 
tween the chronological age of the child and his or her 
developmental age. As with many of the parent mea- 
sures, scores for children in the very low-income families 
were substantially below those of children from more 
moderate-income families on all dimensions (see Table 7). 
For example, months differential on communication de- 
velopment was less than half as great for the poorest 
children, compared with their more moderate-income 
peers. 

However, the effects for the poorest children were 
somewhat stronger and more consistent. Small positive 
effects were noted for the poorest children on three of the 
five DPII measures, and a moderate effect was found on 
the ASBI score; one small negative effect was noted (self- 
help development). This contrasts with one small positive 


TABLE 3. Outcomes for Parent Attitude Measures by Income Level 


Very low income 


More moderate income 


Participant Control Participant Control 
Outcomes group group ES group group ES 
Average score, Parenting Sense of 
Competence Scale 
At 1-year assessment 53.6 (0.9) 55.7 (0.7)  -.34 54.6 (0.8) 56.3 (0.5) -.30 
At 2-year assessment 52.2 (1.0) 53.2 (1.0) -.17 54.7 (0.7) 55.4 (0.5) -.14 
Parenting efficacy subscaleb 
At 1-year assessment 28.3 (0.5) 29.1 (0.3) -26 28.6 (0.4) 28.8 (0.2) -.06 
At 2-year assessment 28.4 (0.4) 29.0 (0.4)  -.20 28.7 (0.3) 28.7 (0.2)  -.02 
Satisfaction subscale® 
At 1-year assessment 25.3 (0.7) 26.6 (0.6) -27 26.0 (0.6) 27.6 (0.4) -.36 
At 2-year assessment 23.8 (0.8) 24.2 (0.7) -—10 26.0 (0.6) 26.7 (0.4) -.16 
Average Child Maltreatment Precursor 
Scale score 
At 1-year assessment 18.4 (0.4) 18.1 (0.3) 12. 19.8 (0.4) 20.0 (0.3) -.08 
At 2-year assessment 17.2 (0.4) 16.8 (0.3) 18 18.6 (0.3) 19.2 (0.3)  -.22 
Percentage of mothers reporting being 
“very happy” when they took care of 
child in last year 
At 1-year assessment 86.8 (4.6) 86.4 (4.5) 01 90.9 (3.9) 92.4 (2.8) -.05 
At 2-year assessment 80.6 (7.1) 74.5 (6.4) AS 98.2 (1.8) 83.1 (4.1) 58*** 
Sample size (1-year/2-year assessment) 57/31 61/47 63/55 100/84 


Note. Bold type indicates moderate and large effects. Numbers in parentheses are standard errors. 
4Gibaud-Walston & Wandersman (1978); total scale (range = 17-68). bRange = 8-32. “Range = 9-36. dErom Adult-Adolescent Parenting Inventory 


(Bavolek, 1984); range = 6-24. 
Peep 001, 
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TABLE 4. Outcomes for Parenting Behaviors Impacts Measured by the HOME Inventory by Income Level 


Very low income 


More moderate income 


Participant Control Participant Control 
Outcomes group group ES group group ES 
Average total HOME score 
At 1-year assessment 29.3 (1.0) 30.3 (0.9) -.12 37.2 (0.8) 37.1 (0.7) .02 
At 2-year assessment 34.7 (1.9) 33.9 (1.0) 1 39.7 (0.4) 38.6 (0.5) 29 
Average HOME subscale scores related to: 
Parental responsivity 
At 1-year assessment 7.3 (0.3 7.6 (0.3) -—11 9.3 (0.2) 9.3 (0.2 .02 
At 2-year assessment 8.6 (0.5) 8.8 (0.4) -.07 10.0 (0.2) 9.9 (0.2) .08 
Acceptance of child’s behavior 
At 1-year assessment 5.4 (0.2 5.7 (0.2) -.17 6.3 (0.2) 6.5 (0.1 -.17 
At 2-year assessment 5.4 (0.3 5.4 (0.3) .04 6.5 (0.2) 5.9 (0.2) AO** 
Organization of the environment 
At 1-year assessment 4.9 (0.2 5.1 (0.1) -.13 5.5 (0.1) 5.5 (0.1 .00 
At 2-year assessment 5.7 (0.2) 5.4 (0.2) 31 5.7 (0.1) 5.6 (0.1) 14 
Appropriate play materials 
At 1-year assessment 5.7 (0.3 5.6 (0.3) .03 7.4 (0.2) 7A (0.2 01 
At 2-year assessment 7.2 (0.4) 6.4 (0.3) 33 8.3 (0.1) 8.2 (0.1) 14 
Involvement with child 
At 1-year assessment 3A (02 3.3 (0.2) -.10 4.8 (0.2) 4.6 (0.2 1 
At 2-year assessment 4.7 (0.3) 4.9 (0.3) —.14 5.1 (0.2) 5.1 (0.2) 01 
Opportunities for stimulation 
At 1-year assessment 2.8 (0.2 3.0 (0.2) -.16 3.9 (0.1) 3.8 (0.1 10 
At 2-year assessment 3.1 (0.2) 3.0 (0.2) 12 4.1 (0.1) 3.9 (0.1) 21 
Sample size (1-year/2-year assessment) 56/30 60/45 62/54 99/80 


Note. HOME = Home Observation for Measurement of the Environment (Caldwell & Bradley, 1984). Bold type indicates moderate and large effects. 


Numbers in parentheses are standard errors. 


py < 01 


effect (the ASBI score) and three small negative effects 
for children from families with more moderate incomes. 


Summary of Effects 


Table 8 summarizes the parent and child impacts at sec- 
ond assessments associated with PAT participation. The 
intent is to examine the pattern of results across mea- 
sures. The table shows that the very low-income families 
experienced somewhat greater benefits than their more 
moderate-income counterparts, as indicated by the pat- 
terns in the effect sizes. However, of all the comparisons 
in Table 8, only three were statistically significantly dif- 
ferent: only one for the low-income PAT versus control 
comparison and only two for the moderate-income PAT 
versus control groups. Of the 28 parent outcome mea- 
sures summarized in the table, very low-income parents 
showed positive effects on 14, with effects being moder- 
ate in size for seven of the outcomes (effect sizes of 
.31-.50), small for seven others (effect sizes of .10-.30), 
and statistically significant for one. In comparison, more 
moderate-income parents demonstrated positive effects 


on eight measures, with two being moderate to large (.49 
and .58) and statistically significant. Child outcomes 
similarly favored very low-income families in terms of 
patterns of effect sizes, with their children achieving 
small benefits in three developmental domains measured 
by the DPII and a moderate positive effect on prosocial 
behavior measured by the ASBI. Only a small effect on 
the ASBI was noted for children of more moderate- 
income families. It is important to note, however, that 
even for the very low-income group that received greater 
benefit, positive impacts as indicated by mainly small ef- 
fect sizes were found for only half the outcomes summa- 
rized in the table. 


DISCUSSION 


We have presented data from a multisite evaluation of 
the PAT home visiting program in an effort to respond to 
the directive from policymakers that research should be 
focused on evaluating programs to families whose chil- 
dren may be particularly at risk for poor outcomes, such 
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TABLE 5. Outcomes for Language- and Literacy-Promoting Parenting Behaviors by Income Level 


Very low income More moderate income 
Participant Control Participant Control 
Mean scale score group group ES group group ES 


Average language/literacy/numeracy promotion scale score? 
At 1-year assessment 18.8 (0.5) 17.9 (0.6) 24 19.4 (0.5) 19.3 (0.4) .04 
At 2-year assessment 19.7 (0.4) 19.1 (0.5) 17 20.1 (0.5) 20.2 (0.5) -.03 


Average language/literacy/numeracy promotion subscale score? 


While doing everyday things, parent: 
Talks to/asks child questions 


At 1-year assessment 3.2 (0.1) 3.1 (0.1) 10 3.3 (0.1) 3.3 (0.1) .00 
At 2-year assessment 3.2 (0.2) 3.4 (0.1) -.30 3.4 (0.1) 3.4 (0.1) .04 
Reads aloud to child 
At 1-year assessment 3.0 (0.1) 2.5 (0.2) .46* 2.8 (0.1) 2.8 (0.1) 01 
At 2-year assessment 3.2 (0.2) 2.8 (0.2) 31 3.0 (0.1) 2.9 (0.1) 17 
Counts, sings, says counting rhymes, or uses 
numbers with child 
At 1-year assessment 3.1 (0.1 3.2 (0.1 .02 3.1 (0.1) 3.2 (0.1 -.11 
At 2-year assessment 3.5 (0.2 3.3 (0.1 26 3.4 (0.1) 3.4 (0.1 .04 
Tells stories, says nursery rhymes, sings 
with child 
At 1-year assessment 3.5 (0.1 3.3 (0.1 21 3.4 (0.1) 3.6 (0.1 -.19 
At 2-year assessment 3.4 (0.2) 2.9 (0.1) 49* 3.3 (0.1) 3.4 (0.1) -.12 
Looks at or reads books with child 
At 1-year assessment 2.8 (0.1 2.8 (0.1 -.03 3.3 (0.1) 3.2. (0.1 16 
At 2-year assessment 3.0 (0.2 3.0 (0.1 01 3.4 (0.1) 3.4 (0.1 -.06 
Talks to/asks child questions while reading 
to child 
At 1-year assessment 3.2 (0.2) 3.1 (0.2) .07 3.5 (0.1) 3.2 (0.1) 16 
At 2-year assessment 3.4 (0.2) 3.6 (0.1) -.19 3.7 (0.1) 3.8 (0.04) -.25 
Sample size (1-year/2-year assessment) 56/30 60/45 62/54 99/80 
Note. Bold type indicates moderate and large effects. Numbers in parentheses are standard errors. 
4Range = 6-24. bRange = 1-4. 
*p <.05. 
TABLE 6. Outcomes for Parent-Child Interactions at Second Birthdays by Income Level 
Very low income More moderate income 
Participant Control Participant Control 
Outcomes group group ES group group ES 
Total NCAST scale score 49.5 (1.7) 48.7 (1.2) .09 53.3 (0.9) 54.2 (0.9) -.12 
NCAST parent scale score 39.0 (1.4) 38.8 (1.0) .03 41.2 (0.6) 40.4 (0.7) 16 
NCAST child scale score 10.5 (1.0) 10.0 (0.7) 10 12.3 (0.7) 13.8 (0.5)  -—30 
Sample size 30 47 54 82 


Note. Bold type indicates moderate and large effects. Numbers in parentheses are standard errors. NCAST = Nursing Child Assessment 
Satellite Training (NCAST, 1994). 


as families living with significant poverty (Duncan et al., of young children have been well documented, much re- 
1994; Gomby et al., 1999; Lewit et al., 1997; Werner, — mains to be learned about which interventions are most 
2000). Although the effects of poverty on the development __ effective in ameliorating the effects of childhood poverty. 
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TABLE 7. Children’s Development at Second Birthdays by Income Level 


Very low income 


More moderate income 


Participant Control Participant Control 
Outcomes group group ES group group ES 
Developmental Profile I14 
Cognitive development 0.3 (0.7) 0.1 (0.5) .07 3.0 (0.6) 4.0 (0.5) -.22 
Self-help development 4.3 (0.9) 5.5 (0.8)  -.23 6.4 (0.7) 6.3 (0.6) .02 
Social development 3.4 (1.0) 2.8 (0.7) 12 5.2 (0.7) 6.2 (0.6) 22 
Physical development 1.6 (1.1) 0.9 (0.8) 12 2.9 (0.7) 3.6 (0.6) 12 
Communication development 2.5 (0.7) 2.0 (0.6) 12 5.9 (0.8) 5.8 (0.7) .03 
Adaptive Social Behavior Inventory» score 70.8 (1.2) 68.5 (1.2) 32 73.3 (0.9) 72.6 (0.7) 12 
Sample size 31 47 55 84 


Note. Bold type indicates moderate and large effects. Numbers in parentheses are standard errors. 
4Alpern, Boll, & Sheaver (1984); average month’s differential. bscott & Hogan (1987). 


The findings from this study revealed that the ef- 
fects of the PAT program generally were small, with few 
being statistically significant, and they did not accrue 
uniformly for all outcomes examined. These findings are 
consistent with several studies of two-generation programs 
for low-income families that found benefits on only some 
of the parent outcomes examined, such as the home 
learning environment; maternal behaviors and attitudes 
toward children (the AVANCE Family Support and Edu- 
cation Program; Johnson & Walker, 1991); parent-child 
interactions (the Comprehensive Child Development Pro- 
gram; St. Pierre, Goodson, Layzer, & Bernstein, 1994); 
and emotional support for children and child-rearing at- 
titudes (the New Chance Program; Quint, Polit, Box, & 
Cave, 1994). Small and somewhat inconsistent impacts on 
child outcomes also are reasonably reflective of findings 
from other studies. For example, a research review by 
Olds and Kitzman (1993) found significant short-term 
program impacts on children’s cognitive or behavioral 
development in fewer than half of the randomized trials 
they reviewed. Even programs that generated benefits to 
parents did not always result in benefits to children (Olds, 
1992; Olds, Henderson, & Kitzman, 1994; Olds, Hen- 
derson, Tatelbaum, & Chamberlain, 1988). However, the 
findings from the current multisite study regarding child 
impacts are weaker than those produced by evaluations 
of some other PAT programs (Pfannenstiel & Seltzer, 
1989; Pfannenstiel, Lambson, & Yarnell, 1995; Wagner 
& Clayton, 1999). 

It is important to note that positive effects for both 
parent and child outcomes accrued more frequently to 
very low-income parents and their children than to more 
moderate-income families. The benefits to very low-income 
families in this study may be particularly important in 
light of the fact that their scores were lower than those 


of less-poor families on a majority of the parent and child 
outcome measures, suggesting that the PAT program 
could help close some of the gap between income groups 
in some aspects of parenting and child development. 

Furthermore, the conclusion that PAT is at least as 
effective and likely more effective with families of chil- 
dren who are most at risk of poor development is con- 
sistent with two other recent evaluations of PAT. Wagner 
and Clayton (1999), in an evaluation of PAT in Salinas, 
California, found that more consistent and stronger ben- 
efits accrued to Spanish-speaking Latina mothers and their 
children relative to English-speaking Latinas and non- 
Latinas. In analyses at third birthdays from one site in 
the multisite evaluation of PAT reported here, which 
compared benefits to teen mothers and their children rel- 
ative to older mothers (Wagner, Iida, Spiker, Hernandez, 
& Song, 2001), a more consistent pattern of benefits was 
evident for teen mothers and their children. One limita- 
tion of the results presented here that is common to such 
evaluations is the inclusion of multiple measures, with 
the resultant problem of having multiple statistical tests. 
Like other researchers, we were attempting to determine 
if a pattern of results existed across these multiple indic- 
tors of program effects. In addition, because the focus of 
the study was to compare income groups, the separation 
between the two income groups was not widely discrepant 
(i.e., many families in the moderate income group also 
had quite low household incomes). Because of sample 
size considerations, it was not possible to compare two 
widely discrepant income groups (e.g., less than $15,000 
vs. greater than $50,000), which may have resulted in 
larger group differences. 

Researchers, policymakers, and practitioners in the 
field of human service acknowledge the need to maximize 
the benefits of programs to young children born into pov- 
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TABLE 8. Summary of Outcomes at Second Birthday Assessments 


Outcomes Very low income More moderate income 


Parenting outcomes 


Parent Knowledge Scale + 


General Child Development subscale 


Language Development subscale + = 
Emotional Development subscale + 

Discipline 

Child care and safety + - 


PSOC Parenting Attitudes Scale - - 


PSOC Parenting Satisfaction subscale - 


PSOC Parenting Efficacy subscale = 


Parents’ happiness caring for children + +40 
Precursor of Child Maltreatment subscale + - 
Total HOME Scale + + 
Parental Responsivity subscale 
Acceptance of Child’s Behavior subscale ++%% 
Organization of Child’s Environment subscale + + 
Appropriate Play Materials subscale + + 


Parental Involvement subscale - 


Opportunity for Stimulation subscale + + 


Language/Literacy/Numeracy-promoting Behavior Scale + 


Talks to child while doing everyday things - 


Reads aloud to child while doing everyday things + + 
Counts, sings, or says counting rhymes or uses numbers + 
Tells stories, says nursery rhymes, sings with child +* - 


Looks at books with child 


Talks to/asks questions of child while reading to child - = 


NCAST Total Scale 7 


NCAST Parent Scale + 


NCAST Child Scale - 


Child development outcomes 


DPII Cognitive Scale score = 


DPI Self-help Developmental Scale = 


DPII Social Development Scale + - 
DPI Physical Development Scale + - 
DPII Communication Development Scale + 

ASBI + + 


Note. PSOC = Parenting Sense of Competence (Giband-Wallston & Wandersman, 1978) scale; HOME = Home Observation for Measurement of the 
Environment (Caldwell & Bradley, 1984); NCAST = Nursing Child Assessment Satellite Training (NCAST, 1994); DPII = Developmental Profile I 
(Alpern, Boll, & Shearer, 1984); ASBI = Adaptive Social Behavior Inventory (Scott & Hogan, 1987). +, - Direction of small effects. +, — Direction 
of moderate effects. ++ Direction of relationships that were moderate or large in size and statistically significant. 


*p < 05. **p:< 01. ***p < .001. 
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erty. Experts recognize that problems exist in program 
implementation that prevent families living in significant 
poverty from becoming involved in even the most effec- 
tive interventions (Werner, 2000). Successfully enrolling, 
engaging, and retaining families is a struggle for program 
directors and early interventionists, particularly for pro- 
grams serving families whose children are at risk for poor 
outcomes (Gomby et al., 1999; Shonkoff & Phillips, 2000; 
Walker, Rodriguez, Johnson, & Cortez, 1995; Werner, 
2000). Recent research on the dimensions of engagement 
in home visiting programs argues for a shift in think- 
ing about enrolling and engaging families from being an 
all-or-none phenomenon to being a dynamic, multi- 
dimensional process (McCurdy & Daro, 2001; Wagner 
et al., 2000). 

It is important to acknowledge two issues regarding 
implementation of this multisite study that likely have 
implications for the effects found. The first is that the in- 
tervention was evaluated only through children’s second 
birthdays although the program is intended to serve fam- 
ilies and children at least through third birthdays. Thus, 
we have not assessed the full effects of PAT if it were to 
be implemented as intended. The second issue relates to 
the first. The evaluation was discontinued in all but one 
site because a significant number of participant group 
families there never began home visits and many others 
dropped out of the program before second birthdays 
(Wagner et al., 2000). Thus, the level of actual interven- 
tion was significantly below the monthly home visits 
called for in the PAT model. It is likely that greater im- 
pact would have been observed if the intensity of inter- 
vention had been closer to expectations. This conclusion 
is supported by some earlier evaluations of PAT, in which 
mothers who received more intensive services benefited 
more (Wagner & Clayton, 1999). 

The difficulties encountered in this study with regard 
to attrition and participation are now being more openly 
acknowledged by researchers and practitioners. For in- 
stance, in a recent review of home visiting program eval- 
uations, Gomby et al. (1999) noted that of the studies 
reviewed, “between 20% and 67% of families leave the 
home visiting program before their intended completion” 
(p. 41), and across a wide range of home visiting programs 
“programs struggled to enroll, engage, and retain fami- 
lies” (p. 6). Gomby and her colleagues concluded that 
such difficulties reduce the ability of evaluations to ad- 
dress efficacy questions convincingly. Moreover, prob- 
lems with recruitment, retention, and engagement also 
may require program modifications to increase the de- 
sired participation. In response to a recognition of the 
importance of key implementation issues, such as en- 
gagement, Gomby et al. stated that “national headquar- 
ters for key home visiting models should bring together 
researchers, practitioners, and parents to formulate prac- 
tice standards and guidelines for their own models, and 
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a dialogue should begin to create learning and quality 
improvement efforts for the field as a whole” (1999, p. 22). 

In this evaluation, there was a great deal of varia- 
tion in the participation of the mothers in the home vis- 
its. Among those randomly assigned to the PAT group, 
22% never began any visits, 35% received some visits but 
dropped out by the Year 2 assessment, and 31% were 
still participating in home visits at the second birthday 
assessment (but even this group had received a variable 
number of visits overall). Because this study was designed 
as a randomized evaluation, all participants with outcome 
assessments are included in the analyses, as required in 
such designs. However, post hoc analyses aimed at de- 
termining if outcomes were related to “dosage” (receiv- 
ing more of the intended home visits) provided some 
support for a positive relationship between receipt of 
more visits and better outcomes, but the results were not 
consistent across outcomes, nor were they much stronger 
than the results reported here (see Wagner, Spiker, et al., 
2001). 

We do not present such post hoc analyses in this re- 
port because they may detract attention from several key 
issues we want to raise. First, we need to conduct more 
quality evaluation research about early childhood and 
parenting programs for low-income families. Second, we 
need to face squarely the many issues about parent en- 
gagement in these programs. We would argue that attri- 
tion and engagement require explicit empirical attention. 
Future studies should be designed with the purpose of 
explicitly examining how we recruit and engage parents 
in early childhood and parenting programs. The study 
reported here is not at all unusual in having high attri- 
tion rates, difficulties in maintaining full participation in 
the program, and outcome data that show disappoint- 
ingly small effects for both children and parents. We 
have argued elsewhere that parent engagement is a mul- 
tidimensional phenomenon that goes beyond the usual 
issues of recruiting at the outset of a program and drop- 
ping out or staying in over time (Wagner et al., 2000; 
Wagner, Spiker, Linn, et al., 2002). In this evaluation, the 
high attrition rate and the less than optimal participation 
in the full intervention greatly limits the possibility of 
finding meaningfully important outcome effects. Like 
others, we report rather weak effects, and we are left with 
many questions about whether the intervention may be 
ineffective in producing intended effects or how much 
the small effects are influenced by insufficient implemen- 
tation of the complete intended program. 

Another limitation of this study was our inability to 
fully examine site differences due to the small sample sizes 
at the outcome assessment points. How differences in some 
of the parent characteristics and variations in attrition 
and program implementation may affect outcomes can- 
not be determined in this study. This problem does raise 
the issue of the generalizability of many of the program 
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evaluation studies in the early childhood field in which 
single sites with relatively small samples are the norm. 
We suggest that future studies should pay closer atten- 
tion to more fully documenting the sample and program 
implementation characteristics to allow for better meta- 
analysis approaches in program evaluation research. 

The results also suggest that future research that 
compares different home visiting models or curricula 
should include measures that could explicitly capture in- 
formation about participation and engagement, or studies 
should be intentionally designed to study engagement. 
For instance, studies are needed to test whether certain 
features of the programs, the home visitors, or the strate- 
gies used by the home visitors relate systematically to 
participation and engagement. We would argue that there 
are not enough good systematically gathered data about 
what goes on inside of homes during home visiting pro- 
grams and how variations relate to the outcomes we strive 
to achieve. For instance, what kinds of strategies used by 
home visitors lead parents to follow through with the 
many literacy-promoting behaviors with their children 
suggested by home visitors? Does the ethnic match be- 
tween the home visitor and parent predict continuing 
participation and the degree of behavior change in the 
parent? Do different approaches to recruitment affect re- 
tention and engagement? Is it possible to design follow- 
up studies that would interview parents who drop out of 
home visiting programs to explore more fully why they 
left and what might have lead to their continuing partic- 
ipation? While there is much conventional wisdom about 
why some parents drop out of such programs (e.g., par- 
ents are too busy or too stressed), empirical data to sup- 
port many assumptions are limited. 

Our results are consistent with other data indicating 
rather weak effects of home visiting programs, raising 
questions about why this is the case. One issue in need of 
more dialogue is the rather ambitious behavior change 
goals of many parenting programs. The focus of the PAT 
program is on child development and parenting behav- 
iors, with an underlying assumption that benefits to 
children from PAT accrue largely through the positive 
parenting skills and behaviors parents learn and practice. 
This means that “success” requires behavior adoption or 
behavior change, not just mastery of knowledge. Par- 
enting behaviors are complex, and changing them some- 
times requires parents to “unlearn” behaviors that are 
deeply rooted in their own childhoods, family, and cul- 
tural traditions but sometimes not supported by influen- 
tial relatives and neighbors in the parents’ communities. 
Some changes also require commitment and perseverance 
on the part of parents, qualities that are difficult for 
some parents to maintain. Thus, whether such behavior 
changes are possible or likely with the kinds and intensi- 
ties of programs like PAT is a question that should be ex- 
amined more explicitly. 


79 


Finally, this study highlights some important meth- 
odological issues. We are beginning to have more early 
intervention, early childhood, and home visiting pro- 
gram evaluations that are using randomized designs, and 
such designs are being strongly advocated for the future 
(e.g., as in the recent recommendations of a national ad- 
visory panel about upcoming Head Start evaluations; 
Advisory Committee on Head Start Research and Evalu- 
ation, 1999). This move toward greater methodological 
rigor is an attempt to reach sound, unassailable conclu- 
sions. However, attrition and less-than-full participation 
in the interventions at their intended levels can hinder 
our ability to reach conclusions about efficacy. The chal- 
lenges are formidable for both evaluators and program 
staff who implement the programs. It is important that 
we disseminate data and experiences from program eval- 
uations like this one where problems with program im- 
plementation occurred and only modest impacts were 
found. Researchers and practitioners need to contribute 
their data, experiences, and insights about less than op- 
timal program implementation in order to move the field 
forward in our understanding about what works and 
what does not work. If we do not bring these problems 
and challenges to light, openly discuss their meaning, 
and actively pursue strategies to remedy them, then the 
goals of improving access and quality of early parenting 
programs to promote the well-being of the neediest chil- 
dren and families we seek to serve will remain elusive. 
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NOTES 


1. The randomized evaluation reported here was conducted prior to 
the implementation of the PAT Born to Learn curriculum and is based 
on the earlier PAT curriculum. 

2. The fourth site withdrew shortly after the recruitment phase of the 
study due to a variety of problems, which included significant diffi- 
culties retaining staff, including turnover in the program director 
and many of the parent educators. The sample characteristics of 
parents at this site were similar to those at the other three sites. 

3. There were some significant differences across the three communi- 
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ties on the background characteristics, but we were unable to ana- 
lyze group differences within site because the sample sizes were not 
adequate for such comparisons. For instance, one community had 
significantly more teen mothers (41% vs. 22% and 24%; p < .001); 
one site had a higher proportion of White mothers (47% vs. 28% 
and 14%; p < .001). Mothers at one site were about half as likely 
to have some postsecondary education than at the other two sites 
(p < .001). The proportion of very low-income families (less than 
$15,000) at the three sites was 51%, 60%, and 69%, with the first 
site being significantly different from the second (p < .05) and third 
sites (p < .001). 

4. The formula used for calculating effect sizes was (mean #1 —- mean 
#2)/ the square root of (standard deviation #12 + standard devia- 
tion #22)/2). The pooled standard deviation takes into account het- 
erogeneity of variances. 
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